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Self-directed learning is tMt'type of learriing'^icH 1$ not 
structured for the student by an irfstructor. Instead, the> student • 
«ust structure his learning himself by wking decisions abQut which 
■aterial^ are relevant to his learning goals, which mater i eh $ re'^wi re 
the priof understanding of which other materials, Snd so on. A 
computer-based system has been developed to train students in this 
type of learning. 

A revised system based on, an earlier version of a computer-based 
self-directed learning system was developed. The improved system 
described herein contains features designed to make it easier for ^jStknts 
to use. *In addition, pedagogical features of the training sys 
been improved, to give students an opportunity to learn the 
completely. ^ ^ • 

An experimental test of the Improved system was dfsigpo tp separ 
ate out the effects of . training in self-directed learnf«j^-rom the use 
of the system itself. Data were colleJilted on four diJBrent measures 
of learning: effective learning, selective leamio^Wlahnfng, and 
verba*! report. Resblts of the experiTCnt" found tlwj^here* were no 
significant differences among treatment groups -IflJ^ performance data 
(the first three learning measures), everr thoug|iine of ^the experin^ntal 
groups outperformed the other groups in every JpSsure. On the measure 
of verbal report, however, this experimentaljjpoup performed signifi- 
cantly better than did the Control group. 
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Self-directed learning is that type of Vear*i?lng whichMs not structure^ 
Tor the student by an instructor. Instead, the stiikJent must structure his 
learning hifoself by making decisions about which materials are relevant to 
his learning goals, which materials require . the prior understanding of which 
Other matertaU, and so on. A computer-based syst^'has been developed «^ 
train students in this type of learning. 
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A revised sjste« ba^ed orw kn earl ietMrers ion of a coaputer-based 
self-di nected .learning system 'was develop^. The iii^>roved systAa described 
herein contains features designed to wke it easier for students to use. 
In- addition, pedagogical features of the training system have been In^roved, 
to give students Ad opportunity to learn the system completely. 

An experimental test of the iirproved system was designed to separate 
out the effects of training in self-directed learning from the use of the 
system itself. Data were collected on four different measures of learning: 
effective learning, selective leaminjg, planning, and verbal report. 
Results of the experiment found 'that there were no significant differences 
anong treatment groups in the performance data (the first three learning 
■easures), even though one of the experimental groups outperformed the other 
groups if! every measure. On the measure of verbal report, however, this 
experimental group performed significantly better than did the control 
group. ^ ^ 



r 

o 



ERIC 



LIST OF FIGURES 

Figure 

y. Combination of Systems Available to Subjects' in 
Each Condition ^ . . . . 



2.' Correlations of Selectivity and Reading Time for', 
• Training + Aids and ContKrl Groups- 1 . . . ; . 



LIST OF TABLES ^' 



J 

Table . 



1. Means and Standard Deviations, of Dependents Measures . . 

2. >teans and Standard Deviations of Individual Difference , 

. Measures • 

t 

3. Combined "lorrelation Matrix , , ; . : 

4. Correlation- Matrix for Trairiing+Aids Group • 

5. Correlation Matrix for Training-Only Group 

6. Correlati^ Matrix for Control Group ' 



ans and Standard Deviations of Strategy Sunmary 
Judgements 



8. ANOVA Suftpary Table for Strategy Summary Judgements 



9. Averaged Strategy Summary Judgemtnts . . . * 



'• ■ .1. *fllTRODUCTIjON . ' . ■ 

* 

Self-directed learning is tKat learning which the student directs. 

himself; that is, no^tructure is imposed on his learning externally. 

This type of learning is found in many on-the-job learning contexts in 

which a worker must make his own decisions aborut just what information 

« 

will help him solve the problem, but he must not waste his time reading 
irrelevant information. He must also structure hU learning in such a 

if he encounters unfamiljAr concepts, he can locate the prerequt^ 
-site-Information he needs to understand those concepts. Self -directed 
learning thus differs dramatically from the typp of learning that goes 
on in the classroom, in which an instructor is available to direct the 
student's learning: Obviously, skills aod strategies necessary for s^f- 
direct^d learning are seldom if ever taught in the classroom. 

We have developed a computer-based self-dicected learning system, 
described in Munro, Rigney, and Crook (1978) and in Rigney, Munro, and 
Crook (in press). Those reports described an early version of this r 
system and the results of a pilot experiment using thh system. This \ 




report will discuss a revised version of the system and the 
larger experiment. 

In the pi Tot ^periment, ^ome of the subjects used the self-directed 
learning aid in solving a complex problem, while the other (control )*subjects 
used a simplified version of the learning aid which did nott include any 
of the self-monitoring features of the. complete Aids system (described 
below). (In effect, the control system is nothing more than a computer- 
based book; as soon as the student selects a title ifi thfe table of contents. 



he is shown the corresponding Information.) ' Data were kept on^iSubjects 
In both the experlmenul and control groups while they solved a complex 
learning task. Various neasures were taken, such as time required to solve 
the task, the nunt>er of errOrTlwde, and several measures of selectivity 
and planning^ tesults *owed that while there' were no signiilicant dif- 
ferences between the groups, the experimental group on the whole performed 
slightly better than the con.trol group, fcre importantly, however, 
experiinental subjects at^he low end of an ability scale (as measured by 
the Nelson-Denny test of reading ability) perfonned better than control 
subjects in the same range. It was therefore concluded that the self- 
directed learning Aid helps students who are poor readert to a greater 
extent than' it helps students who are good readers, the results of thrt 
experiment |nd verbal and written comments made by the subjects suggested 
certain improvements that could be made both irt the automated learning Aid 
and in the twining program that accompanied it. Wiese improvements are 
incorporated iato the current vers^An of the Aids system. 

The self-directed learning Aids system consists of the following 
"pages" or areas of the computer program: 

TASK page: contai;js a statement of the student's learning 
task 

OBJECTIVES page: allows the student to break down the task 
into a set of sub-goals, called objectives 

CONTENTS page: contains a list of the titlts of information 
sources available to the .student ,■ 

♦ 

RELEVANT CONTENTS page: lists only those titles that 
the student has selected as relevant to the task. 



Fi^ any one of these pages, the student can go to any of the others as 
-he wishes; rather than following » strict linear order through the 

progranj, the student is free to move- around as he deems necessary. Each 

• - ■ ' 

page has a number of-functions which the student may use- while on that T 

page. For examplfe'. the, RELEVANT CpNTENTS pageHists all those titfes -^' 

informtion sources that the student hasr selected to reab. From this page 

the student may el^ct to read one of these information sources, ^Q|eck itT^ 

.off if he feels it really is relevant to his learning task, \ it off if 

he feels it is irrelevant, or express dependencies between two information . 

sources (that is. state that one source should be read before the other). 

The current version of the automated Aids system differs from 

that described in Munro, Rigney, and CrooJc (1978) in a number _of ways. 

New functions have been added to some of the-^pages, the goal stack ha^ • 

.'been extensivfly revised, and the matching seet^ion has been eliminated 

altogether." Previously , .students were allowed to procee'd in eitheV a 

conceptually driven (top-down) or data-dri*/en (bot^^up) fashion, 

although the system more easi^ provided for the' latter. That is, students 

would select a titTosand then be asked in the matching section to decide 

which of the objectives the title was relevant for.- Th#e was no overt 

✓ ■ 

mechanism available to them to select an objective first and search for 
titles to help them attain that objective (althoug>i they could of course 
.do this mentally). Many students felt that this .matching procedure was 
"backwards," so the current version of the automated Aid was adopted. 
A student is now led to proceed in a' conceptually driven fashion by first 
selecting an objective to work on, then selecting one. or more titles for 
that objective.^'Tlnce the match is madFas soon as the stuient selects ^ 
a title, there is no need for a separate' matching section in the Aids 




Another feature of the Aids system, the goal stack, was modi iFied , 

nake ft easier'for students to use. Since there is-, limited space on 

screen ;0f the computer .terminal , only the number of goals (objectives 

titles' b^f information' sources) ire displayed in the goal stack. A ; 

ture was added to the current version to allow the student to touch 

of these -numbers. On the streen and be shown that goal written out* in 

1. The student roay also -elect to see all the other goals which are 

ated to that.goal written out in full, along witb the depenjJency rela* . 

nships they form with the original goal. New functions which werre 

ed include a 'Mask "Analysis" box on the TASK page which helps the 

dent formulate objectives for *the specific task'domain he is working 
« 

and \ "Select" box ton the OBJECTIVES page which ^allows the student to ' 
ect an abjective to work on. 

^ In addition to improvements '^made to*the self-directed learning Aid 
elf, several improvements were^ade to the training program which 
ompanies' it. (The Aids system- is a rather complex system which requires 
umber of hours of training in its use before students feel comfortable 
h it.) Long, expository passages in the original version have been 
ken down into shorter screen displays, and short quizzes appear much 
e frequently than they did in the earlier training program. In addit^ion, 
h training session now begins with a quiz reviewing the contents of 
previous session. These changes were deMgned to keep the student more 
ively involved with the training program. 

It was noted after the pilot experiment that experimental subjects 
I a more difficult learning task than control subjects did. Each training 
sion included sample probletns to practice using the automated Aids system 

^ •A- 
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but only the exptrimental subjects had to learn tc^use^the Aids systems 
in addition— the control version of the "Aids" system required no training 
beyond the; initial session. Consequently, the current training progVam 
used simple practice problems, allowing the students to concentrate fully 
on the details of the Aids system. These simple problems involved deci- 
sions concerning maritime rules of the road. The final (testing phase), 
session of the training program, however, used a complex learning task. 
This task required students to troubleshoot or debug a simulation of a 
sentence generator having one "faulty" component. ^ 

Finally, the effects of training in self-direction and jthe use of 
the automated Aid were separated in this study. The pilot experiment 
compared experimental subjects who had both training and the Aids system 
against control subjects who had neither. The present experiment cpmpared 
the results of three different groups to evaluate the effects of *both 
training and the use of the automated Aids system. 



^ II. EXPERIMENT 

i ' ' ' • ■ • ■ 

An experiment was conducted to test the effects of the ^elf- 

directed learning Aid discussed in Section I. 

Experimental Design ^ 

The experiment was designed'to test the following two research 
hypotheses: (1) students who are trained in self-direction strategies 
will solve a complex learning task more quickly and efficiently than 
students who are not trained and (2) when students ajre trained in self- 
dipection strategies, those students who are provided with the automated 
Aids system to facilitate the use of those strategies will sclve the task 
more quickly and efficiently than the students who are not provided with 
the Aids system. Su^ects were assigned at random to one ^ the following 
conditions: 

(I) Training plus Aids system-. Students "were trained in self- 
direction strategies and in the use of the Aids system. During the final 
session (during which data on student performance was collected), they 
were provided with the Aids system designed to facilitate application 

of the strategies. 

(II) Training and.no Aids system: Students were trained in self- 
direction strategies and in the use of the Aids system in the same way 

as Group I. During the final se'ssion, they were not ^i^n the Aids 
system; instead, they had to accomplish the task using the same apparatus 
available to the group below. - •• 

(III) *No training and no Aids system: Students were given no 
training in self-*di recti on strategies, nor did they have the Aids system 
avaiUble during the final problem-solving session. 



The first research hypothesis is tested by comparing the performance 
of students in Condition II with that of students in Condition III, while 
the second hypothesis is tested by comparing the performance of students 
irt Condition I with that of students in Condition II, This design is 
similar to a 2 x 2 factorial except that the cell corresponding to "No 
training and Aids system'* was omitted because students could not be 
expected to use the complex Aids system without prior training in its use. 

During the testing pKase, students in the training*only and contn)! 
groups (Conditions II and III) use an automatedrtystem containing only 
the Task and Contents pages of the system described in Section I. Students 
>n these groups have the same learning task and the same information to 
read, but they have none of the Aids system available to students in the 
training-plus-Aids group iPerWition I). (Information sources in this 
simplified system are accessed directly from the Table of Contents. As 
soon as the student touches a title, he is shewn the corresponding 
information source.) 

The training sequence for control subjects is similar to that for 
the other students, except that the basic system is never modified for 
them, so there is no nered for teaching sessions other than the Initial 
one. Thus, sessions two and three are practice sessions using the 
control system, and session four is the testing phase. The training 
phase for students in the trainingronly group is identical to that for 
students in the trainlng-plus-Aids group. During the final session, 
however, the training-only students use the control system rather than 
the self-directed learning Aids system. The, combinations of different 
systems used in all three conditions are shown in, Figure 1. 
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I . ' II . Ill 









Aids 
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System 


System 
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Figure 1. Combinations of Systems Available to 

Subjects in Each Condition, ^ 
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Method 

/. , 

Subjects for the experiment were volunteers recruited from a ' 
lower-level NROTC course at^nfiajor unlWrsity. Thirty-nine Subjects 
were assigned at random to each of the three condition^ discussed above 
The studtftts were told that they would receive exposure to junior-level 
NROTC course iiM|jteAal by participating in the experiment as well as 
twenty dollars for temple t^ng the experiment, Duringjthe test session, 
they were. told that they cou'UTreteiiie an additional two dollars for 
solving ttie task correctly on the^Virst attempt or an additional one 

^dollar for solving It on the second attempt. The reason for this bonus 
was tt> discourage random guessing and to encourage students to have a 

'fair degree ot confidence in their apswer. 

Data Collection 

The data collected during the final session were designed to 

measure both effective learning and self^directed letming. Effective 

learning is defined in terms of the tiwe spent reading information and 

tht number of errors made in attemptifig to solve the task. Data are 

collected for each student on the number of erroneous attempts (wrong 
« 

answers) made when the student attempts to perform the task and the 
total time the student spends reading information sources to solve the 
task. Self-directed learning is much more difficult to measure, but 
it seems to be typified by two phenomena: planning and selectivity in 
the use of available information sources- The data collected reflect 
operational definitions of these phenomena. 



PI tnning ^ ' » 

It is not an easy matter to discover whether a student is engaged 
in effective planning. One type of data- saved by ou/ PLAtO prog^m Is 
the sequence in which students accessed the information resources > 
available to theni. Oui analysis of the troubleshooting task presented 
to the students .in' the ttstinq-phase has resulted in the formulation of 
a set of rules for scoring deviations from the ordef In which the 
information sources should be accessed. These rules, which we call 
anti -precedency rules; take the form of prohibitions of ce'rtain sequences. 
The extent to'^hich a student has departed from sequences permitted by 
an ideal task^analysis can be expressed in terms of the number of times 
the student's study sequence vipVates the anti -precedence rules. 

Basically, the anti-precedence rules require that the student not 
read about a subcomponent of the sentence generator unless he has first, 
read about the conponent which contains it. A particular rule is 
violated if the student either fails to read about the larger component 
or reads about it after reading about the subcomponent. • These rules thus 
^reflect the idea that a student should not attempt an actior until he has 

completed its prerequisite. 
♦ 

Selectivity in the Use of Information Sources 

Selectivity has to do with reading information sources which are 
relevant to the learning task and not reading the irrelevant information 
sources. The ratio of relevant information sources read to all informa- 
• tion sources read is a iwasure of sele:.ti vity ; a student for whom this 
.ratio is high has read primarily relevant sources and few irrelevant 
ones. Two different ratios of this type were computed, the first a ratp 

-10- 



of the nuwber of infonnatiQn sources read and the second a ratio of the 
time spent reading those information sources. That is. the first is the 
ratio of the number of relevant information sources read, to the total 
nuthber of infopwtion sources read, and the second is the ratio of the 
time spent reading relevant information sources to the time spent reading 
all information sources. 

Subject Strategy Sunmaries 

In addition to collecting data on effective learning and self- 
directed learning, we attempted to validate the schema representations 

"I 

given in the Appendix. Following the fifijl session, students were asked 
to describe the "learning techniques or strategies" that they used in 
solving the complex troubleshooting task. Their summaries of these 
strategies were analyJed usring a modified form of the method for scoring 
text recalls and summaries described in Gordon. Munro, Rigney. & Lutz 
(1978), to try to determine if subjects in different treatment groups 
would suirmarize their strategies differently. This method of text 
analysis examines sunmaries for occurrences of statements of particular 
^relevance for self-directed learning, that is, the representations pre- • 

( 

sented in the Appendix. These were translated into short English 
Statements, and three' judges scored the siJhwaries pf strategies for the 
» presence of these statements. 



Results 

ich of the three treatment ( 



For each of the three treatment groups, means and standard deviations 
were coiiputed for the dependent measures and individual differences vari- 
ables. >The means for the dependent measures are presented in Table 1, and 

* 



tht mans for the Individual difference measures are given In Table 2. 
Visual Irfspectlon of the results presented In Table 1 reveals that the 
training- only group perfonhed worse than both the tralnlng-plus-alds 
and the control groups on almost every measure. In retrospect, this 
result seems unsurprising, since the training in self-direction that 
the subjects were given was, for the most part, either oriented toward 
or Interpretable in terms of the functions of the Aids system. Students 
in the training-only group were required to solve a complex prtiblem in 
the final session using an "aids" system with which they were unfamiliar. 
The comparison of the training*plus-aids group to the control group wrtll 
therefore be emphasized below/ 

The nuHber of errors made in solving the complex problem Is a 
measure of the effe(>ti veness of the learning strategies that students 
use to accomplish their task. Although a paired comparisons test did 
not reveal a significant difference between the two groups of interest, 
inspection of the descriptive statistics indicates that the control group 
made slightly more errorsion the average and varied more wi'dely in their 
performance. The varianc«of the control group is about twice that of 
the treatment group. This suggests that the treatment served to reduce 
individual variation in complex problem solving. A second measure of 
learning effectiveness is the amount of time spent reading the information 
resources.' The training-plus-aids group spent less time reading the 
Information than the control group, but again the difference did not reach 
significance. , ^ 

The other three variables Included in Table 1 are measures of -self- 
dlrectedness during problem solving that require the use of text. All 
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Table 1 



Means and Standard Devlstlons 
of Dependent Measures 



Variables 



Treatment Conditions 



Training •*• Aids Training-Only 



Control 



Reading Time X 
(minutes) SD 



20. D5 
(14.71) 



41 .89 
(33.93) 



27.44 
(13.12) 



Errors 



X 
SD 



1 .23 
(1.54) 



3.31 
(3.20) 



1.62 
(3.D2) 



Selectivity in X 
Titles Picked SD 



.77 
( .17) 



.61 
( .17) 



.68 

( .22) 



Selectivity in 
Time v 
Allocation ^ 



Planning 
• .Violations 



X 
SD 



.71 
( .2D) 



1.39 
(1.5D) 



.62 
( .18) 



,1.54 
(1.13) 



.67 
( .24) 



1 .5R 
(1.56) 



2^- 



difftrencts between the two groups are iy\ the predicted direction but are 
. not significant. Students in the training-plus-aids group were somewhat 
■ore selective "in choosing only relevant titles and also spent more of 
their time reading relevant information than did the contn)ls. The . 
treatment conditions also resulted in fewer planning violations than^did 
the control condition. 

• Therefore, as ass^wed both by final performance and by behaviors 
during problem solving, the treatment condition produced slightly (but 
not significantly) more effective and self-directed learning. 

Individual differences in learner ability were compared ac^ross 
groups.- No differences were found, indicating that the randomization 
procedure successfully yielded similar groups. Scores on both verbal and 
.matherr^tics sections of the Scholastic Aptitude Text (SAT) were obtained, 
and group means of these scores are shown in Table 2. 

All variables were correlated with one another, and the overall 
correlation matrix is shown in Table 3. Several relationships are 
noteworthy. There were strond relationships between error scores and 
the two measure^'of selectivity, r « -.57 and -.51 (£<.05) for reading 
choice and time'«llocation respectively. These strong negative correla- 
tions between errors and selectivity indicate that greater selectivity 
•during problem solving corresponds to fewer errors. This finding is 
important because it suggests that selectivity, as operationally defined 
in this study, does in fact result in more effective learning. In other 
words, selectivity does result in better problem-solving performance. 

" Another interesting relationship is that found between errors 
and reading time, r « .32 (£<:.05). Apparently, as students spent more 
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Means and Standard Deviations of 
Individual Difference Measures 



Variables 



Treatment Conditions 



Training * Aids Training-Only Control 



SAT: Verbal 



X 
SO 



588 
( 85) 



542 ^ 
( 57) 



566 
•( 76) 



SAT: Math 



X . t 637 



SO 



t Oil 

V ( 58) 



635 
( 41) 



615 
( 64) 



SAT: Composite X 
SO 



1225 
{ 85) 



1184 
( 75) 



H85 

(105) 



^9 



• I, 



A. 



Reading Tli 



Table 3 

ItJmblwd Correlation Matri;( 



B 



r 



B. 


Errors 


.31* 


























C. 


Selectivity' 1 (title choice) 


-.28 


-.57* 










0. 


SeleJjtivity 2 (time allocation) 


-.24 


-.51* 


.90* ' 








\ 


Planning Violations 


.06 


J7 


-.55* 


-.64* 






F. 


SAT: Verbal 


-.01 


-.40.* 


.10 


-.02 


.03 


> 


G. 


SAT: Math 


-.01 


-.27 


.16 


.18 


-.06 


-.14 


H. 


SAT: Composite ^ 


-.02 


-.54* 


.14 


' .10 ( 


-.01 


.78* 



Note. N » 39 except due to missing data 
* B < .05 
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time reading thfe information, they tended to perform worse (make more 
errors). This positive relationship between reading times and erVors 
is opposite of the expected relationship between time and performance— . 
namely, that the more time a student spends learning the better hel or 
she should do on a criterion test- The relationship observed in this 
study suggests that students who were more efficient (who sperjf less time 
reading) were also more effective in that thpy solv^ij the ta^BWUh fejer 
errors. Further support for this conclusion is found in^||^ inverse 
relationship between reading time and selectivity, r « -,28 (title chQicfe) 
and r « -.24 (time allocation). While neither of these correlations is 
significant, the negative tendency suggests %iat students who were more* 
selective tended to t^^ke less reading time tb solve the firoblein. 

Finally, it is interesting to no^e the strong correlations among 
the three measures of self-direction--;pelect4 vi ty in title choice, 
selectivity in time allocation, and planning violations. The two 
selectivity ratios are strongly related, r « ,$0 (£ < ,05). Thi6 rela- 
tionship suggests that students who selected the appropriate information 
to read also-allocated their time to reading that^nformatfon. The 
selectivity measures are negatively relai^d to planning errors, -,55 
and - .64 (P< .05) for title choice and time allocation, respectively. 
The negative relationships sug§est that sti/dents who 'choose selectively 
anr>d spent most of t*^§|i*time reading appropriate information did so 
according to the proper sequence. The three measures of self-direction 
used in this study Were therefore, consistent in their asi^ssment of 
student behaviors. 
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A ptitude bygreatment In teractions' (^Tl) 

. The confclned correlation matrix cannot reveal any differences 
betiieen the treatment conditions. Therefore, correlations between 
variables were examined for each treatment group Individually. These 
correlations appear In Tables 4. 5. and 6'. Visual examination of the 
data indicates an overall pattern of differences between the three treat- 
«ent groups. In general, the expected relationships between ability, time, 
and performance^occur only In'the control .condition. F6r example, we 
wouKl expect stUdenJs of higher verbal ability to need less reading time 
to solve the problem (and lower ability students ta^requlre more reading 
time). Yet. the expected negative correlation between these two variables 
(verbal ability and reading time) occurred only In the control condition. 
• r « .50. .05. and -.48 for training i aids. ^training, and control groups. 
Vespectively. The correlations between verbal ability and error scores 
also fail to.be strongly negativ^ except for the control group, r = -.18. 
' -.12 and -.71 respectively. In other words, only In the confrol condition 
was the negative correlation significant (£<.05). Ability, then, is 
predictably related to the dependent measures only In the control condition 
• . The relationship between ability and self-direction also seems to 
fit our expectation only In^the ^1 group. We^uld expect students 
o; higher verbal ability to be mor^ selective and make fewer planning 
violations.' Although we would predict that ver^l ability and selectivity 
Ire positively related, a positive correlation between ability and select- 
ivity in time allocation occurred only In the control condition, r « -38. 
-.47. anl .55 re~spect1vely. -Slmnar-ly,- the correlation between ability 
- and selectivity In .title choice.was positive only for control subject^'. • 



Table 4 

*. Correlation Matrix for Trainingf Aids Group 







A 


B 


C 


D 




F 


h. 


Reading Tline- • ' 




* 


f 




ft 




B. 


Errors 


.35 




* 




« 




C. 


Sjelectlvlty 1 (title choice) 


-.21 


-.40 










D. 


Selectivity 2 (time allocation) 


-.14 


-.09 


.83* 








E. 


Planning Violations 


.30 ' 


.03 


-.61* 


-.67* 






F. 


SAT: Verbal 


.50* 


-.18 


-.12 


-.38 


.27 




G. 


SAT: Math 


-.15 


-.26 


.41' 


.53 


-.26 


-.33 


H- 


SAT: Composite 


.39 


-.35 


.16 


. -.01 


.09 


.77* 



.35 



Note : N = 13 except due to missing data 
E < .05 
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Table 5 

Correlation Matrix for Training-Only Group 







A 


B 


C - 


D 


E 


1. 


Reading Time 








• 




ft. 


Erjnors 


.23 










G> 


Selectivity 1 (title choice) 


-.08 


-.60* 
















* 


0 




D. 


Selectivity 2 (time allocation) 


-.09 


-.57* 


.91* 






E. 


Planning Violations 


-.10 


-.23 


' - .32 


-.49* 




F. 


SAT: Verbal 


.05 


-.IZ 


-.49 


-.47 


.44 


6. 


SAT: Hath 


-.35 


-.55* 


.49 


' .35 


.19 
















H. 


SAT: ^ Composite 


-.19 


-.53* 


-.01 


-.09 


.36 




Note: N = 13 except due to missing data 











£ < .05 



.14 

.>8* .51 
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Tables 












Correlation Matrix for Control Group 












A 


B C 


D 


E 


F 


A. 


Reading Time 












B. 


Errors 


.28 










C. 


^ectlvlty 1 (Title choice) 


-.67* 


-.55* ' 








D. 


Selectivity 2 (time allocation) 


-.67* 


-.62* » .97* 








E. 


Planning Violations 


.16 


.59* -.69* 


-.72* 






F. 


SAT: Verbal . 


-.48 


-.71*- .46 


.55 


-.50 




6. 


SAT: Math 


.59* 


-.21 -.18 


-.17 


-.03 


.72* 


H. 


SAT; Composite 


.03 


*.6?* .08 


.23 


-.28 


.78* 



G 



.68* 



Hote: N = 13 except due to missing data 
£< .05 ' 
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r • -.12. -.49. and'^e respectively.' Furthenwre. we would expect that 
verbil •bility is inversely related to violations In planning, yet the 
obUined correlations did not match that prediction except in the control 
condition, r - .27. .44. and -.50 respectively. Hence.* the eifpected. 
relationships bet»*een verbal ability and measures of self-directedness 
did not*hold except for students in the control condition. 

Several other fxpected relationships held only for the control 
condition; We would expect that selectivity would decrease reading time 
so that these variables should be negatively correlated. While the > 
correlations are negative for all three groups fr - -.21 and -.14 for 
training-plus-aids, r » -.08 and -.09 for training-only^ and r - -.67 and. 
-.67 for control), they are significant only in the control group. The 
final prediction is that planning violations should be related to errors 
because inefficient learners are probably ineffective as well. The 
correlations are r » .03. -.23. and .59. respectively. In other words, 
the naturally expected correlation between planning violations and errors 
is found only in the control condition. .. 

The ATI evidence shows that expected relationships between ability 
and performance held only for the control group. It seems likely that 
students of high ability in the experimental groups may have been hampered 
by the cuntersome mechanics of the Aids system, which promo^d less 
efficient strategies than they would have used on their own. Less capable . 
students in the experimental groups, who may have had no useful strategies. 
Mere probably helped by the features of the Aids systeA This explana- 
- tion is supported by the reduced varjance i_n errors fMrnJ in the traini^ 
ni..c arouD as comoared with the control group. 



Strategy Su—ary Results 

Means and standard deviations for the scored strategy suMiarles 
are giverv in Table 7. A 2- factor analysis of varjance (AHOVA) with 
repeated- Measures on the rater factor was performed on tihese data* and 
the results appear in Table 8. Differences among the treatment condi- 
tions are significant^ £ « 5.34, £< .01. AlthougH differences among 
the raters are also significant, the interaction between the two factors 
is r\oX significant (F « 1.93, N.S.), indicating that group differences 
in reported strategies are not a function of rater bias. Therefol"!!^ 
strategy scores were averaged across raters (the inter-rater reliability 
coefficient is .81). The resultant group means are shown in Table 9.. 

0 . 

' 01 fferejjces between the training-plus-aids and, the training-only groups 
are significant (t (24) « 2.93, £< .01), and the differences between; the 
training-plus-aids and the control group are also significant (t (24) « 
2.38, £ < .05). We may conclude, then, that students in the training-plus 
aids group learned significantly more of the self-direction learning^ 
strategies than did students of either of the other two groups. 

Why students in the training-plus-aids group should report dif- 
ferent strategies than those in the training-only group is difficult to 
understand. One explanation that seems' likely relies upon the fact that 
students were instructed to produce Suwmaries -that you used to solve the 
problem you just worked on." As we have already seen in the performance 
data, students in the training-only group performed quite poorly. It 
seems likely that they were not making use of the self-directed learning 
strategies during the final session. The fact that they d+d not produce - 
summaries of the self-direction strategies does not necessarily mean that 



Title 7 

Iteans and SUndard Oet^iations of 
Strategy" Smnmary Judgements 

Treatment Condi tior 



Training * Aids Training-Only 



J 1.5 '"-5 

SO (1.3) ( -7) 

J 3.5 1-9 

SD (1.8) (1-6^ 



J 3.0 
SD 



1.5 



(I'.e) (1-4) 



'33 
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Table 8 



ANOVA Sunnary Table for Strategy 
Sunnary Judgements 



Source 



Between Treatment Condition 
Error^j 

Hlthln Raters 

Interaction 
Error^ 

£ < .01 



df 

2 

36 

2 
4 

72 



19.56 

3.67 

35.41 
1.821 
.94 



F 

5.34* 



37.55* 
1.931 



Table 9 

Averaged Strategy Summary 
Judgements 



I 
SO 



Training •*• Aids 

2.7 
(1.4) 



Treatment Condition 
Training- Only 



1.3- 
(1.0) 



Control 

r 1.6" 
(0.9) 



* £< .05 for comparison to Training ••■ Aids ^roup. 
£< -05 for<orapar1son to Training ••■ Aids group, 
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they did not leim the strategies. Rather, they may have ii««p1y been 
obeying the instructlars by not describing the strategies that they failed 
to use. 

. Discussion 

Our anaVyses of the data on self-direction and reading effect- 
iveness found no significant differences due to group. Therefore, the 
results did not support either of our research hypotheses (that training 
in self-directed learning wo'uld improve perforwance^d that use of the 
aids system would further improve performance). There was. however, a ^ 
•non-significant tendency in the data for those students who had both 
received training and h^ad the use of the aids system during th? test to 
perfonr, better than the students in the other two groups.^ It is possible 
that with note training practice or with more subjects these results might 
have reached significance. It is noteworthy that the training-plus-^ids 
group outperformed the other two groups on each of the performance measures 
we took. On only one measure, the scores for su«r»ari2ed strategies, did 
the perfonnance of the training-plus-aids group significantly exceed that 
of the other-two groups. Interpretation of this result is problematic. 
Those students who were both trained in the use of the self-directed 
learning aids system and given access to thit system'in the test session 
were able to later sunmarize the pr*rciples of the system in writing. 
^ -Yet other students who had received the same training (th« training-only 
group) but did not practice with it in the last session were no better 
tnen control subjects at expressing the strategies. , - ' 

An unexpected espect of our results «as the (non-significant) 
difference between the control group and the group that was trained in 



the use of the ilds system but did not have the use of tha^systen during . 
the test. Ue had predicted that the training-only group would perform 
letf well than the tra1n1ng-p1us-a1ds nrouD» but better than the control 
group* Ifistead» control group students did better than those In the 
training-only group- In retrospect, this result seems quite natural. j 
students In the training-only group received training In the use of one 
computer-based aids system but were lested on their facility with another. 
The switch In systems may well have been confusing, and this could have 
caused their performance to deteriorate. Another possibility, however. 
Is that training In the use of the experimental aids system does not 
Improve one's ability tp learn in a self-directed, selective way. Perhaps, 
on the contrary, it* creates a kind of Intellectual dependence on the 
facilities of the aids system. When these facilities are removed, those 
who have been trained in their use perform less well than those who have 
not been exposed to the aids system. Given the nonsignificance of the 
results, such conclusions arei at best, merely speculative. 

An Interesting aspect of the resuMs is the finding that different 
learning measures are related. The two measures of effective learning 
(reading time and errors) are significantly correlated, as are the three 
measures of self-directed learning (two selectivity ratios and planning 
^^^/fTblations). The question naturally p^sents itself: Is effective 
learning related t» self-directed learning? Of six possible relation- 
ships, only one was found to be signif 1cant--select1v1ty of title choice 
is Inversely related to number of errors. In the control condition, however, 
three other relationships emerge. Both selectivity ratios are inversely 
related to reading times, and planning violations are directly related 
to errors made in attempting the task. Why should these relationships 



appear only In the control condition^ Scatter diagrans of these relation- 
ships show that the control condition represents the expected relationship. 
For example, Figure 2 plots selectivity of thle choice against reading 
tliie. For students in the control condition, the less selective they are, 
the BO^e ti«e they spend reding. This relatt^fifhi'p does not seem to 
hold for the students in tf>e training-plus-aids group, however! 

The results of the research reported here lend support to two 
conclusions that we believe are also supported by other recent results 
In cognitive research. The first is that huwn learning and human 
thinking are not very general pn^cesses, but are always closely linked 
to fairly detailed or specific situations. The second conclusion is that 
human learning strategies or skills are highly automatized; as a result, 
even inefficient learning strategies nay lead to Superior performance 
when they are compared to the use of non^utomatic strategics. - In the 
remainder of this paper we will present evidence for thise two claims 
and discuss their implications for training research. 

^ A number of theorists in cognitive science (for example, Goldstein 
I Papert, 1977) have gently proposed that models of'humaiv thought should 
• Include few, if any, general processes. Rather,' knowledge and thought are 
best represented as a collection of quite specific concepts, concepts that 
are boun<l to particular restricted entities in particular situations. If 
this claim has substance, It may be that the strategies that subjects in 
our, training groups learned were somehow closely bound up in their minds 
with the topic «atter of the example learning problems that were used 
during training. In the training sessions, subjects were given problems 
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Figure 2. Correlations of selectivity and reading tlnie 
for training ♦ aids and control groups. 

X * El, 0 - C ■ . 



on the Rules of the Ro.d. The test session, however, used a very different 
(and «ch «re .o^licated) problem of troubleshooting a defective device. 
Subjects may have learned the strategies that they had bfi^taught in such 
, way that iCcould apply them only to Rules of the Road problems. Some 
of the co«r«nts made by the subjects in their written evaluations of the 
experiment seem to reflect this problem: ' 

-Tn st^rt with l^de up 4 goals objectives to complete 
before'? \TJu "co^Jts^^e ?ask^ Then as ^ -[^f^^^ve 
information 1 noticed thlt some (most?) of my objectives 
were not really suited to the subject. 

"This problem was a little dmerent in regards to 
Strategy than others "^t 1 pdint."' 

■ "The third problem set. after learning 9oalltaclc, 

S^tSl TrHniJ" Jl!^tS.°«s,'to incorporate .11 f»t1P»! 
of the system." 

"If the practise [sic] problems were more difficult it 
would help repare [sicl the leamar." 

■ "More practice with tougher problems.^' 

off much better if the areas studied were a lUtie more ^ . 
ficult and challenging." 
If this process (of learning strategies only with respe* to certain 
toRlc-matter domainsVis as widespread as we fear it is. a number of 
measures should be taken to improve the results in atte.^ing to teach 
such strategies. Two methods come to^ind. First^the aj^cations for 
-which the strategies are intended should be closeiy exa^ If they 
WTong to a restirfcted class, then th>iiracti ce wtjf l.a^K tra 
in the strategies should all come" from that cla«-5^C0hd. if the. 
applications are not ««*ers of a restrict^^cllK^hen as wide a 



training 



^* . .J ^ ' 

variety of practice problems should be used as Is possible. The training 
« 

process will almost certalnljn; have to be more protracted In such a case. 

The second general conclusion about human learning that we have 
been led to Is that adults* learning strategies, have been highly auto- 
matized. Rigney (1978) has reviewed evidence on this IsjMe. If tWs 
claim Is true, we should not 1)e surprised to discover that our experimental 
subjects, who should have been using superior strategies, did hot do 
significantly better than those subjects In the control group^ 'first. It 
1$^ possible that, for many of our experlmental^ubjects, the highly over- 
learned old Inefficient strategies automatically went Into action and 
_ # an 

competed with the- new, less well-learned strategies we had taught them. « 
Second, If some experimental subjects were sble to use the new strategies 
we had taught them, they could have been at a disadvantage with respect 
to the control subjects who used their old strategies; The coq^lrol 
subjects^ strategies could be activated. automatically, and should have . 
required little conscious cohtrpl. The new, unfamiliar techniques used • 
by the experimental subjects, however, would sorely require considerable 

- * \ 9 

conscious control, thus reducing the processing resources available for 
learning and problem solution. )f1ewed In this light, the fact that 
experimental subjects did not do significantly worse than control siibjects 
se^ms. to support the essential validity pf the learning techniques em- 
bodied in the aids system. 
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Prescriptive Schema^§ Ami ned as a Result y 
Training in Self-directed Learning Strategies 
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0) SELF-QIREtTb-LEARNING (TASK) 
. 1$ when 
• BUILD-GOAL-STRUCTURE (TASK) 
TASK-PURSUE (TASK) 
end- 

(2) BUILD-GOAL-STRUCTURE (TASK) \ ' 

Is when 

♦ 

ANALYZE (TASK, for OBJECTIVES (TASK))* 
PREREQUISITE-SEARCH (For EACH (OBJECTIVE). IN OBJECTIVES) 
PREREQUISITE-SEARCH (for EACH (OBJECTIVE), in CONTENTS) 
end. , 

(3) TASK-PURSUE (TASK)* 

is when 
EXAMINE (GOAL-STRUCTURE) 

UNTIL (CHECKED (EVERY (OBJECTIVE)), PURSUE {OBJECTIVE)) 
TASK-ATTEMPT (TASK) . - 

end. 

(4) TASK-ATTEMPT (TASK) 

is when ^ .. ». ■ 

IF (DO (TASK), then QUITE. eUe SELF-DIRECTED-LEARNING (TASK)) 

♦ 

end. ' . ■ ^ ■. 



' *The ANALYZE sub-schema has not yet been '^P''e""^«j- ^JJJ^. 
people are able to discover the prerequisites pr. component actions of 
« Usk Is not well understood. 



> m 

(5) PREREQUISITE-SE/mCH (for GOALS, in SUBGOAL-SET) 

is when 

FOR-EACH (MEMBER, of SUBGOAL-SET), 
V . IF (PREREQUISITE (MEMBER, for GOAL), 

then (SPECIFY-DEPENDENCY (MEMBER, to OBJECTIVES-LIST)))) 
end. 

(6) PURSUE (GOAL)* , 

is when 

FOR-EACH" (SUBGOAL (NECESSARY (SUB60AL, to GOAL)) in GOAL-STRUCTURE. 
WHILE (ANY (UNSATISFIED (SUBGOAL' (NECESSARY (SUBGOAL' , to 
SUBGOAL))))'. 

PURSUE (SUBGOAL')) 
■ TRIAL (SUBGOAL )) 
end. . ■ 

(7) UNSATISWED (GOAL) . 

. is when 

NOT (CHECKED (GOAL)) - ^ • 

• NOT (ELIMINATED (GOAL)) - • . , 

end. ' ' 0- 

. (8). TRIAL (GOAL) 
is when 

^ ATTEMPT (ACTION, of GOAL) - 
EVALUATE (GOAL) 
end. 



♦This structure is a variant of Rumelhart & Ortony's (1977) 
schema for TRYing, a subschema of their PROBLEM- SOLVING schema. 
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(9) EVALUATE (GOAL) 

Is when ' 
IF (NECESSARY (GOAL, to HIGHER-GOAL). 

then IF (SATISFIED (GOAL), then CHECK (GOAL), 

else TASK-PURSUE (TASK), 
else' ELIMINATE (GOAL, from GOAL-STRUCTURE)) 

end. 

(10) AHEMPT (GOAL) 

t 

is when • , • 

'■S IF (BELfEVE (CAUSE (ACTION, SATISFIED (GOAL))), 
then DO (ACTION). 

else when SUCCEED (PREREQUISITE-SEARCH (for GOAL)). 
ATTEMPT (PREREQUISITE (GOAL))) 

end." ' 
According to the first of these schemata, the student believes • 
thn' the way to achieve a task through self-djrected learning is first 
to build a goal structure and second to ^Jrsue the task, using that goa| 
structure. The second schema listed above describes what is involved 
in building a goal structure. One analyzed a Usk for objectives (sub.-, 
goals necessary for the perfomance of the task), then one searches 
for prerequisite relationships among these ^jectives. between the 
atlllable information resources and the objectives, and among the rele- 
vant available inform^ion sources. . Howfver. the schema does not conta^ 
explicit reference to the process of adding these relationships to the • 
goal structure., because the goal structure Is constructed for the student 
by , the program that tids him or he|jin self-directed leeming. The fifth 
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schema listed above i* an essential .part of the goal -structure-building 
schm. since it specifies how the search for prerequisites is conducted. 

The second major part of self-directed learning, after building 
a goal structure, according to the above schemata, is to pursue the task. 
The third schema above gives- the top-level structure for task pursuit. 
One examines the hew ly constructed goal structure first; then one pursues 
tht objectives included in that goal structure until every one of then 
has been checked.. (Checking is the proems by which a student marks the 
itta.inment of a subgoal , using the Aids program on PLATO). When all the 
necessary objectives have been checked, the student attempts the task. 
If the attempt fails (see schema #4), then he begins the self-directed 
learning process again, reconstructing or modifying the goal structure. 

The pursuits of objectives is governed by the sixth schema given" 
above. This is a recursive procedure that traces down dependency rela- 
tionsliips in the goal structure. When a goal is found that has no pre- 
requisites, that goal is subjected to a trial, this means (see 18, 9 
ft -10) that the student does an action to bring about th^ goal and then 
evaluates the results of that action. If the goal is satisfied, he 
checks the goal and then pops back to the appropriate point in the 
procedure that is pursuing an objective. If it is not satisfied, he 
looks for a new way to pursue his overall task; If the attempt reveals 
that the goal was unnecessary to the^attainment of its higher goal, 
then it is dropped from the goal Structure. 

I. ■ 



